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DETAILED ACTION 



Response to Amendment 



1. 



In response to the office action from 4/30/2007, the applicant has submitted an 



amendment, filed 8/30/2007, amending independent claims 1, 28, and 44, while arguing to 
traverse the art rejection based on the limitation regarding domain agents having access to 
services associated with each of the domain agents (Amendment, Pages 14-15). Applicants 
arguments have been fully considered, however the previous rejection is maintained, altered with 
respect to the amended claims and due to the reasons listed below in the response to arguments. 

2. In response to the amended claims, the examiner has withdrawn the previous claim 
objections directed towards minor informalities. 

3. As no terminal disclaimer has been filed, the previous Double Patenting rejection is 
maintained. 



Response to Arguments 



4. 



Applicant's arguments have been fully considered but they are not persuasive for the 



following reasons: 
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With respect to Claim 1, the applicant argues that Lin et al ("A Distributed Architecture 
for Cooperative Spoken Dialogue Agents with Coherent Dialogue State and History, " 1999) fails 
to teach the feature of "a natural language speech processing system that... selects at least one 
domain agent . . . having access to services associated with each of [a] plurality of domain 
agents" because Lin teaches domain switching for domain agents operating independently of 
each other, wherein a current agent would be disconnected whenever domain switching occurs 
(Amendment, Pages 14-15). Thus, the applicant argues that Lin does not teach that a particular 
selected dialogue agent has access to services associated with a plurality of dialogue agents. 

In response, the examiner notes that the present claim language does not require the 
concurrent operation of multiple domain agents that have access to or share the services of the 
other domain agents, as the applicant argues (operating independently ...a current agent would be 
disconnected whenever domain switching occurs, Amendment, Page 15), Instead, the amended 
claim language recites u the selected domain agent having access to services associated with each 
of the plurality of domain agents", which is taught by Lin. As can be seen in Fig. 3, each spoken 
dialogue agent (SDA) has access to the same set of Internet-enabled services and databases. 
Also, each SDA can access information services as a result of a shared dialogue/state history 
(Fig. 3), In this cooperative case, an SDA can access services of all the SDAs through other 
SDAs via a switching routine ("sends the dialogue state and history to the new SDA ", Section 
3.1), For example, a bus travel SDA can access train services and weather services through the 
corresponding SDAs via a passed dialogue/state history (see example in Fig, 6), Thus, since all 
SDAs have access to the same set of Internet-based services and can access all other 
informational services through SDA switching and a passed dialogue/state history, Lin discloses 
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the aforementioned claim limitation. It is further noted that although the invention may be 
described in the specification as having a different functions associated with agent 
interoperability, such functions are not clear in the current claim scope. 

The art rejection of the remainder of independent/dependent claims is traversed for 
reasons similar to claim 1 (i.e., "a natural language speech processing system that... selects at 
least one domain agent . . . having access to services associated with each of [a] plurality of 
domain agents", Amendment, Pages 15-16). In regards to such arguments, see the response 
directed towards claim 1 . 

Claim Objections 

5. Claims 36-37 are objected to because of the following informalities: The parent claim 
number has been deleted from the claims and no new claim number has been added. It is 
believed that both claims should be amended to include claim -33— similar to amended claims 
34-35. 

Appropriate correction is required. 

Double Patenting 

6. The nonstatutory double patenting rejection is based on a judicially created doctrine 
grounded in public policy (a policy reflected in the statute) so as to prevent the unjustified or 
improper timewise extension of the "right to exclude" granted by a patent and to prevent possible 
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harassment by multiple assignees. A nonstatutory obviousness-type double patenting rejection 
is appropriate where the conflicting claims are not identical, but at least one examined 
application claim is not patentably distinct from the reference claim(s) because the examined 
application claim is either anticipated by, or would have been obvious over, the reference 
claim(s). See, e.g., In re Berg, 140 F.3d 1428, 46 USPQ2d 1226 (Fed. Cir. 1998); In re 
Goodman, 1 1 F.3d 1046, 29 USPQ2d 2010 (Fed. Cir. 1993); In re Longi, 759 F.2d 887, 225 
USPQ 645 (Fed. Cir. 1985); In re Van Ornum, 686 F.2d 937, 214 USPQ 761 (CCPA 1982); In re 
Vogel, 422 F.2d 438, 164 USPQ 619 (CCPA 1970); and In re Thorington, 418 F.2d 528, 163 
USPQ 644 (CCPA 1969). 

A timely filed terminal disclaimer in compliance with 37 CFR 1.321(c) or 1.321(d) may 
be used to overcome an actual or provisional rejection based on a nonstatutory double patenting 
ground provided the conflicting application or patent either is shown to be commonly owned 
with this application, or claims an invention made as a result of activities undertaken within the 
scope of a joint research agreement. 

Effective January 1, 1994, a registered attorney or agent of record may sign a terminal 
disclaimer. A terminal disclaimer signed by the assignee must fully comply with 37 CFR 
3.73(b). 

Claims 1-56 are provisionally rejected on the ground of nonstatutory obviousness-type 
double patenting as being unpatentable over claims 1-40 of copending Application No. 
10/452,147. Although the conflicting claims are not identical, they are not patentably distinct 
from each other because both applications essentially refer to the same system/method. 
Although application 10/452,147 additionally recites a parser and event manager in the 
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independent claims, these elements would be inherently included in the structure of the 
independent claims of the present application because the present application includes natural 
language understanding features (which requires parsing) and speech forwarding (which requires 
the use of an event manager). Thus, both claimed systems/methods are not patentably distinct 
from each other. 

This is a provisional obviousness-type double patenting rejection because the conflicting 
claims have not in fact been patented. 

Claim Rejections - 35 USC §103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

8. Claims 1-4, 6, 17-18, 21-23, 27, 44, 46, and 51-54 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Bennett et al (U.S. Patent: 6,615,172) in view of Lin et al ("A 
Distributed Architecture for Cooperative Spoken Dialogue Agents with Coherent Dialogue State 
and History," 1999). 

With respect to Claim 1, Bennett discloses: 

A speech unit that receives the user generated natural language speech utterance and 
converts the user generated natural language speech utterance into an electronic signal, said user 
generated natural language speech utterance having at least one of a query and a command 
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(coding a spoken query, Col. 10, Line 54- Col 11, Line 17; and Col 15, Line 53- Col 16, Line 
21)\ 

A natural language speech processing system that receives the electronic signal, that 
retrieves said at least one of said query and said command from the electronic signal, that selects 
at least one application portion associated with said at least one of said query and said command, 
that forwards said at least one of query and command to said at least one application portion, 
wherein said at least one application portion receives, processes and responds to said at least one 
of said query and a said command (natural language speech recognizer that retrieves a query 
from a speech signal and forwards the question to a specific application portion to retrieve an 
answer, Col 24, Line 46- Col 25, Line 67; Col 27, Lines 17-51; and Col. 29, Line 30- Col 30, 
Line 7)\ and 

A transceiver, in communication with said at least one application portion, that transmits 
an electronic message associated with said at least one of query and command (server capable of 
receiving coded speech queries (as noted in the above cited columns) and transmitting retrieved 
answers, Col 29, Lines 21-29, which would inherently require transceiving means). 

Although Bennett discloses processing a natural language query, forwarding the query to 
a specific application portion based on context, and method use with multiple application 
domains (Col 29, Line 47 -Col 30, Line 2), Bennett does not explicitly disclose the use of 
arbitrating means for selecting and forwarding a query to an executable dialog agents associated 
with different domains. Lin, however discloses a user interface agent that enables query 
forwarding to a particular dialog agent for answer retrieval (Sections 2.2- 3.1 and Fig. 3). Lin 
further teaches that each spoken dialogue agent (SDA) has access to the same set of Internet- 
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enabled services and databases (Fig. 3). Also, each SDA can access information services as a 
result of a shared dialogue/state history (Fig. 3). In this cooperative case, an SDA can access 
services of all the SDAs through other SDAs via a switching routine ("sends the dialogue state 
and history to the new SDA ", Section 3.1), Additionally, Lin teaches an architecture wherein a 
user interface, agent receives responses from the specific SDAs and then transmits them to a user 
(Fig. 3). 

Bennett and Lin are analogous art because they are from a similar field of endeavor in 
information retrieval systems utilizing speech recognition. Thus, it would have been obvious to 
a person of ordinary skill in the art, at the time of invention, to modify the teachings of Bennett 
with the interface agent taught by Lin in order to handle dialog across multiple subject domains 
(or applications) efficiently and intelligently (Lin, Section 1). 

With respect to Claim 2, Lin further discloses: 

The natural language speech processing system further comprises an event manager, said 
event manager coordinating interaction between components of the natural language speech 
processing system (user interface agent, Fig. 3). 

With respect to Claim 3, Bennett further discloses: 

The natural language speech recognizer, as applied to Claim 1 . 

The natural language speech processing system further comprises a parser that 
determines a domain for the user generated natural language utterance based on the content and 
context of the user utterance (natural language understanding means utilizing parsing to 
determine an application domain based on user speech content and context, Col 11, Line 59- 
Col. 12, Line 10; Col. 17, Lines 28-36; and Col. 27, Lines 17-51). 
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Also, Lin discloses the data used by a speech recognizer and parser is domain dependent 
and supplied by a SDA domain (Section 1; and Fig. 2- domain dependent lexicon, grammar 
rules, and language models). 

With respect to Claim 4, Bennett further discloses: 

A text to speech engine that converts a text message to a speech message (text-to-speech 
engine, Col 10, Lines 54-67). 

Also, Lin discloses the data used by a speech synthesizer is domain dependent and 
supplied by a SDA domain (Section 1; and Fig. 2- domain dependent generation flows for 
generating a speech synthesis response). , 

With respect to Claim 6, Lin further discloses dialog domain agents associated with 
travel information (Fig. 3). 

With respect to Claim 17, Bennett further discloses: 

The transceiver is a wide-area RF transceiver (RF link over a cellular network, Col 10, 
Lines 33-53). 

With respect to Claim 18, Bennett further discloses: 

The speech unit includes a speech coder (speech coding means, Col. 15, Line 53- Col. 16, 
Line 21). 

With respect to Claim 21, Bennett further discloses: 

The speech coder uses an adaptive lossy audio compression (speech encoding that 
includes only the least amount of information necessary to adequately and quickly complete 
speech recognition, Col. 15, Line 543- Col. 16, Line 21). 

With respect to Claim 22, Bennett further shows: 



Application/Control Number: 10/618,633 Page 10 

Art Unit: 2626 

The speech unit is located remotely from the natural language speech processing system 
and the transceiver (Fig. 1). 

With respect to Claim 23, Bennett further discloses a display (Col. 10, Lines 54-65). 

With respect to Claim 27, Bennett discloses a network for cellular phones (Col. 10, Lines 
33-53), while Lin recites a common database of dialog states/histories shared across multiple 
common agents (Fig. 3). 

Claim 44 contains subject matter similar to Claim 1, and thus, is rejected for the same 
reasons. 

Claim 46 contains subject matter similar to Claim 6, and thus, is rejected for the same 
reasons. 

Claim 51 contains subject matter similar to Claim 17, and thus, is rejected for the same 
reasons. 

With respect to Claim 52, Bennett discloses a speech filtering means (Col. 15, Line 53- 
Col. 16, Line 14). 

Claim 53 contains subject matter similar to Claim 18, and thus, is rejected for the same 
reasons. 

Claim 54 contains subject matter similar to Claim 27, and thus, is rejected for the same 
reasons. 

9. Claims 7-12, 19, 45, and 55-56 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Bennett et al in view of Lin et al and further in view of Gerson (U.S. Patent: 
6,937,977). 
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With respect to Claims 7-10, Bennett in view of Lin discloses dialog agents capable of 
retrieving responses to speech inputs for a number of different applications, as applied to Claim 
1 . Bennett in view of Lin does not specifically disclose an application domain related to 
communicating with a vehicle device in order to enable device control. Gerson, however, 
discloses a vehicle control server application that recognizes a control command and 
communicates a command message back to a vehicle device to enable device control (Col. 6, 
Line 66-Col. 7, Line 15). 

Bennett, Lin, and Gerson are analogous art because they are from a similar field of 
endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Bennett in view of 
Lin with the vehicle device control application taught by Gerson in order to increase system 
applicability by enabling its use for hands-free control of vehicle devices (Gerson, Col. 6, Line 
66- Col. 7, Line 15; and Col. 9, Lines 5-8). 

With respect to Claim 11, Gerson further shows the vehicle control application located 
remotely from a vehicle (Fig. 1). 

With respect to Claim 12, Gerson further discloses control of a vehicle entertainment 
system and other vehicle devices (Col 6, Line 66- Col. 7, Line 15). 

With respect to Claim 19, Gerson further discloses an echo canceling block capable of 
eliminating echoes and noise in varying conditions that provides the benefit of preventing an 
echo from being recognized at a speech recognizer (Col. 9, Line 24-Col 10, Line 10). 

Claim 45 contains subject matter similar to Claim 12, and thus, is rejected for the same 
reasons. 
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With respect to Claim 55, Gerson further discloses receiving a speech utterance in a 
vehicle (Col. 9, Lines 5-22). 

Claim 56 contains subject matter similar to Claim 27, and thus, is rejected for the same 
reasons. 

10. Claims 5, 13-16, 28-29, 31-37, 41, and 47-50 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Bennett et al in view of Lin et al and further in view of Hedin et al (U.S. 
Patent: 6,185,535). 

With respect to Claims 5 and 13, Bennett in view of Lin discloses dialog agents capable 
of retrieving responses to speech inputs for a number of different applications, as applied to 
Claim 1 . Bennett in view of Lin does not specifically disclose the communication of a 
recognized command with a remotely located service, however, Hedin discloses a speech 
recognizer that sends a recognized speech command message to an external service (Col. 9, Line 
36- Col. 10, Line 24; and Fig. 3, Elements 205, 207 and 307). 

Bennett, Lin, and Hedin are analogous art because they are from a similar field of 
endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Bennett in view of 
Lin with the remote service communication means taught by Hedin in order to enable access and 
control of remote server applications (Hedin, Col. 2, Lines 39-42). 

With respect to Claim 14, Hedin discloses the remotely located specialized services as 
applied to Claim 13. 

With respect to Claim 15, Hedin further discloses: 
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The transceiver transmits the message via a communication network (wireless 
communication network, Col 5, Lines 34-55). 

With respect to Claim 16, Bennett further discloses: 

The communication network is a wide area wireless network (cellular network, Col 10, 
Lines 33-53). 

Claim 28 recites subject matter similar to Claims 1-2 and 5, and thus, is rejected for the 
same reasons. 

With respect to Claim 29, Bennett discloses the speech coding process as applied to 
Claim 18. 

Claim 31 contains subject matter similar to Claims 1 and 6, and thus, is rejected for the 
same reasons. 

Claims 32-33 contains subject matter similar to Claim 5, and thus, is rejected for the 
same reasons. 

With respect to Claim 34, Hedin further discloses the remotely located server device as 
shown in Fig. lb. 

Claim 35 contains subject matter similar to Claim 15, and thus, is rejected for the same 
reasons. 

Claim 36 contains subject matter similar to Claim 14, and thus, is rejected for the same 
reasons. 

Claim 37 contains subject matter similar to Claim 17, and thus, is rejected for the same 
reasons. 
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Claim 41 contains subject matter similar to Claim 22, and thus, is rejected for the same 
reasons. 

With respect to Claims 47-48, Bennett in view of Lin discloses dialog agents capable of 
retrieving responses to speech inputs for a number of different applications, as applied to Claim 
44. Bennett in view of Lin does not specifically disclose the communication of a recognized 
command with a remotely located service device, however, Hedin discloses a speech recognizer 
that sends a recognized speech command message to an external service (Col. 9 t Line 36- Col. 

10, Line 24; and Fig. 3, Elements 205, 207 and 307). 

Bennett, Lin, and Hedin are analogous art because they are from a similar field of 
endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Bennett in view of 
Lin with the remote service communication means taught by Hedin in order to enable access and 
control of remote server applications (Hedin, Col 2, Lines 39-42). 

Claim 49 contains subject matter similar to Claim 1 5, and thus, is rejected for the same 
reasons. 

Claim 50 contains subject matter similar to Claim 14, and thus, is rejected for the same 
reasons. } 

1 1 . Claim 20 is rejected under 35 U.S.C. 103(a) as being unpatentable over Bennett et al in 
view of Lin et al and further in view of DeLine et al (U.S. Patent: 6,420,975). 

With respect to Claim 20, Bennett in view of Lin discloses the dialog agent system 
capable of receiving and encoding a user speech input, as applied to Claim 18. Bennett in view 
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of Lin does not specifically suggest that a speech input from a user is received via a one- 
dimensional microphone array, however DeLine discloses the use of such an array in a speech- 
enabled control system (lined array of microphones, Col 48, Lines 53-63). 

Bennett, Lin, and DeLine are analogous art because they are from a similar field of 
endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Bennett in view of 
Lin with the one dimensional microphone array taught by DeLine in order to enhance vocal 
signal content and eliminate acoustic noise (DeLine, Col. 48, Lines 53-63). 

12. Claims 24-26 are rejected under 35 U.S.C. 103(a) as being unpatentable over Bennett et 
al in view of Lin et al and further in view of Turnbull et al (U.S. Patent: 6,980,092). 

With respect to Claims 24-25, Bennett in view of Lin discloses the speech interactive 
system, as applied to Claim 1 . Bennett in view of Lin does not specifically suggest system 
implementation in a telematics control unit. Turnbull, however, discloses implementation of a 
speech interactive system embedded in a telematics device (speech recognition processing, Col. 
30, Line 43- Col. 31, Line 2, in an in-vehicle telematics assembly, Col. 29, Lines 56-63; 
controlling in-vehicle devices in response to recognized voice commands, Col. 28, Line 53- Col. 
29, Line 36, Col. 30, Line 43- Col. 31, Line 2, and Col 36, Lines 57-63; and control bus for 
sending control signals to the various vehicle devices, Fig. 11, Element 102). 

Bennett, Lin, and Turnbull are analogous art because they are from a similar field of 
endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Bennett in view of 
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Lin with the telematics unit taught by Turnbull in order to implement a speech communication 
and control system that can be readily installed in a vehicle (Turnbull, Col. 3, Lines 20-22). 

With respect to Claim 26, Turnbull discloses the in-vehicle telematics unit as applied to 
Claims 24-25. 

13. Claims 30, 38-39, and 42-43 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Bennett et al in view of Lin et al further in view of Hedin et al and further in view of 
Gerson. 

With respect to Claim 30, Bennett in view of Lin and further in view of Hedin discloses 
dialog agents capable of retrieving responses to speech inputs for a number of different 
applications, as applied to Claim 28. Bennett in view of Lin and further in view of Hedin does 
not specifically disclose an application domain related to communicating with a vehicle device in 
order to enable device control. Gerson, however, discloses a vehicle control server application 
that recognizes a control command and communicates a command message back to a vehicle 
device to enable device control (Col. 6, Line 66-Col 7, Line 15). 

Bennett, Lin, Hedin, and Gerson are analogous art because they are from a similar field 
of endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Bennett in view of 
Lin and further in view of Hedin with the vehicle device control application taught by Gerson in 
order to increase system applicability by enabling its use for hands-free control of vehicle 
devices (Gerson, Col. 6, Line 66- Col. 7, Line 15; and Col 9, Lines 5-8). 
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With respect to Claims 38-39, Gerson further discloses an echo canceling block capable 
of eliminating echoes and noise in varying conditions that provides the benefit of preventing an 
echo from being recognized at a speech recognizer (Col 9, Line 24-Col 10, Line 10). 

With respect to Claim 42, Gerson further discloses receiving a speech utterance in a 
vehicle (Col 9, Lines 5-22). 

Claim 43 contains subject matter similar to Claims 27 and 42, and thus, is rejected for the 
same reasons. 

Conclusion 

14. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 . 1 36(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 
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1 5. The prior art made of record and not relied upon is considered pertinent to applicants 



Elio et al ("On Abstract Task Models and Conversation Policies, " 1999)- discloses 
cooperative dialog agents that share informational resources. 

Turunen ("Adaptive Interaction Methods in Speech User Interfaces, " 2001)- discloses a 
interactive dialog system where all components has access to all informational system services. 

16. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James S. Wozniak whose telephone number is (571) 272-7632. 
The examiner can normally be reached on M-Th, 7:30-5:00, F, 7:30-4, Off Alternate Fridays. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Patrick Edouard can be reached at (571) 272-7603. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



disclosure: 



James S. Wozniak 
10/25/2007 
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